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[57] ABSTRACT 

A method and system for displaying a series of images 
captured by a digital camera, which includes a user interface 
that includes a view finder. The method and system first 
stores each of the captured images in memory, and then 
displays a plurality of image cells in the view finder, wherein 
each of the image cells corresponds to one of the captured 
images. The method and system further provides at least one 
of the image cells with an image area for displaying the 
corresponding captured image, and further provides the at 
least one image cell with an icon area for displaying addi- 
tional information regarding the corresponding captured 
image. 

13 Claims, 8 Drawing Sheets 
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METHOD AND SYSTEM FOR DISPLAYING images in memory, and then displays a plurality of image 

IMAGES AND ASSOCIATED MULTIMEDIA cells in the view finder, wherein each of the image cells 

TYPES IN THE INTERFACE OF A DIGITAL corresponds to one of the captured images. The method and 

CAMERA system further provide at least one of the image cells with an 

5 image area for displaying the corresponding captured image, 

FIELD OF THE INVENTION and further provide the at least one image cell with an icon 

The present invenUon relates generally to digital cameras, ^'^^ displaying additional information regarding the 

and more particularly to a method and system for displaying corresponding captured unage. 

images in the interface of a digital camera. According to the system and method disclosed herein, a 

30 file format is provided that supports the direct display of 

BACKGROUND OF THE INVENTION image cells in the view finder. In addition, graphical icons 

, , , . , . • 11 . . J . displayed in the image cell regarding the media types 

Modem digital cameras typically include an ima^g associated with the image, thereby increa^ng the ease of use 

device which is controUed by a computer system. The operation of the digital camera, 
computer system accesses raw image data captured by the 15 

imaging device and then processes and compresses the data BRIEF DESCRIPTION OF THE DRAWINGS 
before storing the compressed data into an internal memory. 

Efficient operation of the computer is therefore an important PIG. 1 is a block diagram of a digital camera that operates 

consideration for camera designers and manufacturers. The in accordance with the present invention, 
memory architecture of a particular computer system deter- 20 FIG- 2 is a block diagram of the preferred embodiment for 

mines data storage techniques and can thus significantly the imaging device of FIG. 1. 

effect the operational efficiency of the entire digital camera piG. 3 is a block diagram of the preferred embodiment for 

system. the computer of FIG. 1. 

Due to architectural limitations of conventional digital FIG. 4 is a block diagram depicting a user interface for the 
cameras, there are several drawbacks in the user interface 25 digital camera 

that restrict how captured images are displayed and manipu- 5 ^ y^^^ ^ ^^^^^ ^ ^^ .^^ ^^^^^^ 

lated by a user The user mterface m conventional digital ^^^^^^^ ^ ^^^^ ^jj^ ^ accordance with the 

cameras typically mcludes a view finder for displaying a ^ . • 

f • n c u ■ 11 • * i- 1 present invention, 
series of image cells. Each unage cell, in turn, displays a 

small version of a corresponding captured image. Display- 30 ^ ^lock diagram illustrating the format of an 

ing several cells in this manner allows a user to review ^^Apauucu cen. 

several images at once. When the user selects one of the cells FIG. 7 is a table listing example media types and corre- 

in the view finder, the full-sized version of the image is then spending icons that may be associated with a captured 

displayed in the view finder. image. 

One problem with conventional digital cameras is that the FIG. 8 is a block diagram of one preferred embodiment 

file format for storing captured images does not direcUy for a extended file format for storing a captured image that 

support the display of image cells. For example, most supports the display of thumb nail images in accordance 

traditional digital cameras store compressed images in a with the present invention. 

particular file format in memory. The file typically includes FIG. 9 is a block diagram of a second preferred embodi- 
both a header that optionally stores the date and time that the *° ment for the extended file format that supports multiple 

image was taken, and the captured image data itself. The media types. 

captured image is usually stored in the file as a Joint piG. 10 is a block diagram illustrating a multiple image 

Photographic Expert Group (JPEG) data. fii^ format that supports multiple image media types. 

When a conventional digital camera is to display a series 

of image cells in the view finder, the digital camera must first DESCRIPTION OF THE INVENTION 

retrieve the JPEG data from the appropriate files, decom- xhe present invention relates to an improvement in dis- 

press the data, and then process the uncompressed images by playing images in a digital camera. The following descrip- 

resizing the images to the size of the image cells. One tion is presented to enable one of ordinary skill in the art to 

drawback to this approach is that the decompressing and make and use the invention and is provided in the context of 

resizing operations reduce the speed at which the camera can ^ patent appUcation and its requirements. Various modifica- 

display the fuU-sized images in the view finder tions to the preferred embodiment will be readily apparent to 

Another drawback is that the file format for storing those skilled in the art and the generic principles herein may 

captured images does not support the storage of additional be applied to other embodiments. Thus, the present invcn- 

informalion regarding each image that may be of use to the tion is not intended to be limited to the embodiment shown 

user. Thus, a conventional digital camera that has stored but is to be accorded the widest scope consistent with the 

many pictures can only offer the date and time that each principles and features described herein, 

image was captured to distinguish the images for the user. The present invention is a digital camera that includes a 

Accordingly, what is needed is an improved system and method and system for displaying captured images in a 

method for displaying captured images in a digital camera, digital camera. According to the present invention, a method 

The present invention addresses such a need. and system is provided for supporting the direct display of 

cTiN^N/f Aov r^c TTJc rxn^Nmr^Kf ^^^e c&Us in the view finder, and for extending the image 

SUMMARY OF THE INVENTION ^^^^ ^ach image in order to provide addiUonal information 

The present invention provides method and system for regarding the image, 
displaying a series of images captured by a digital camera 65 Referring now to FIG. 1, a block diagram of a camera 110 

that includes a user interface which includes a view finder. is shown according to the present invention. Camera 110 

The method and system first store each of the captured preferably comprises an imaging device 114, a system bus 
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116 and a computer 118. Imaging device 114 is optically preferred embodiment of the present invention, removable 

coupled to an object 112 and electrically coupled via system memory 354 is typically implemented using a flash disk, 

bus 116 to computer 118. Once a photographer has focused Power supply 356 supplies operating power to the various 

imaging device 114 on object 112 and, using a capture components of camera 110. In the preferred embodiment, 

button or some other means, instructed camera 110 to 5 power supply 356 provides operating power to a main power 

capture an image of object 112, computer 118 commands bus 362 and also to a secondary power bus 364. The main 

imaging device 114 via system bus 116 to capture raw image power bus 362 provides power to imaging device 114, 1/0 

data representing object 112. The captured raw image data is ^48, ROM 350 and removable memory 354. The secondary 

transferred over system bus 116 to computer 118 which power bus 364 provides power to power manager 342, CPU 

performs various image processing functions on the image lo DRAM 346. 

data before storing it in its internal memory. System bus 116 Vow/qt supply 356 is connected to main batteries 358 and 

also passes various status and control signals between imag- '^^'^^P batteries 360. In the preferred embodiment, 

ing device 114 and computer 118. * °^^y connect power supply 356 to an 

„ „ . , ^ LI 1 J- r.t. r J external power source. During normal operation of power 

Referring now to FIG. 2, a block diagram of the preferred yy 35^^ ^^ain batteries 358 provide operating power 

embodiment of imagmg device 114 is shown. Imaging 15 ^^^^^ ^^^^^^ ^^.^^ ^^^^ provides the operating 

device 114 preferably compnses a lens 220 having an iris, a power to camera 110 via both main power bus 362 and 

filter 222, an image sensor 224, a timing generator 226, an secondary power bus 364. 

analog signal processor (ASP) 228, an analog-to -digital During a power failure mode in which the main batteries 

(A/D) converter 230, an interface 232, and one or more 358 have failed (when their output voltage has fallen below 

motor 234. ^0 a minimum operational voltage level) the backup batteries ' 

In operation, imaging device 114 captures an image of 360 provide operating power to power supply 356 which 

object 112 via reflected light impacting image sensor 224 th^n provides the operating power only to the secondary 

along optical path 236. Image sensor 224 responsively P^w^^ bus 364 of camera 110. Selected components of 

generates a set of raw image data representing the captured camera 110 (including DRAM 346) are thus protected 

image 112. The raw image data is then routed through ASP ^Sainst a power failure in main batteries 358. 

228, A/D converter 230 and interface 232. Interface 232 has Power supply 356 preferably also includes a flywheel 

outputs for controlling ASP 228, motors 234 and timing capacitor connected to the power line coming from the main 

generator 226. From interface 232, the raw image data ^.^ "^^^^ ^f^""^^ suddenly fail the 

passes over system bus 116 to computer U8. fy^^^^^ capacitor temporardy mamtains the voltage from 
^ „ ^ . ^ ^ . , , , . ^, n ,30 the main batteries 358 at a sufficient level, so that computer 

Refernng now to FIG. 3, a block diagram of the preferred ||o ^ ^^^^^^^ ^^^^^ ^^^^ currcnUy being processed by 

ciuuuuiment ror computer 118 is shown. System bus 116 camera 110 before shutdown occurs 

provides connection paths between imaging device U4, According to the present invention, the flexible architcc- 

power manager 342, central processing unit (CPU) 344, ture of the digital camera provides an improved method for 

dynamic random-access memory (DRAM) 346, input/ displaying captured images in a digital camera. More 

output interface (I/O) 348, read-only memory (ROM) 350, specifically, the present invention provides a method and 

and buffers/connector 352. Removable memory 354 con- system for direcUy displaying image cells and for extending 

nccts to system bus 116 via buffers/connector 352. the cells of each image, such that the ceUs contain additional 

Alternately, camera 110 may be implemented without information regarding the image. In a preferred 

removable memory 354 or buffers/connector 352. embodiment, image cells are extended through the use of an 

Power manager 342 communicates via line 366 with extended file format, and the additional information con- 
power supply 356 and coordinates power management tained in the extended image cells takes the form of graphi- 
operations for camera 110. CPU 344 typically includes a cal icons, as explained further below, 
conventional processor device for controUing the operation piG. 4 is a block diagram depicting a user interface 400 
of camera 110. In the preferred embodiment, CPU 344 is 45 for the digital camera as described in co-pending U.S. patent 
capable of concurrenUy running multiple software routines application Ser. No. 08/702,286, filed on Aug. 23, 1996, 
to control the various processes of camera UO within a entitled "A Method and System For Grouping Images In A 
multi-threading environment. DRAM 346 is a contiguous Digital Camera," and assigned to the Assignee of the present 
block of dynamic memory which may be selectively alio- appUcation. In one preferred embodiment, the user interface 
cated to various storage functions. 50 includes a view finder 402, an image capture button caUed 

I/O 348 is an interface device allowing communications a photo button 404, a four-way navigation control button 

to and from computer 118. For example, I/O 348 permits an 406, a menu button 408, a menu area 410 within the view 

external host computer (not shown) to connect to and finder 402, and function keys 412. The user interface may 

commnunicate with computer 118. I/O 348 also permits a also include an optional sound button 414 and a mode button 

camera 110 user to communicate with camera 110 via an 55 416. 

external user interface and via an external display panel, Referring again to FIGS. 1 and 4, the user interface 400 

referred to as a view finder. operates in two modes: view finder mode and review mode. 

ROM 350 typically comprises a conventional nonvolatile In a preferred embodiment, the photo button 404 is a two 

read-only memory which stores a set of computer-readable position button. The view finder mode begins when a user 

program instructions to control the operation of camera 110. 60 aims the camera at an object 112 and presses the photo 

Removable memory 354 serves as an additional image data button 404 into the first position. Once this occurs, the view 

storage area and is preferably a non-volatile device, readily finder 402 displays the image of the object 112 as shown 

removable and replaceable by a camera 110 user via buffers/ through the camera's imaging device 114. The user may then 

connector 352. Tlius, a user who possesses several remov- press the photo button 404 into the second position to 

able memories 354 may replace a full removable memory 65 capture the image shown in the view finder 402. Review 

354 with an empty removable memory 354 to effectively mode begins by pressing any other button on the interface 

expand the picture-taking capacity of camera 110. In the 400. 
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Referring again to FIG. 4, once in the review mode, the 
view finder 402 displays a series of cells 418 that represent 
the digital images that have been captured in the digital 
camera. The view finder 402 is shown here as displaying 
nine image cells 418. Each cell 418 displays a small-sized 
image corresponding to one of the captured images. The user 
may navigate through the series of displayed ceUs 418 in the 
view finder 402 using the four-way navigation control 
button 406 in order to select which image is displayed 
full-sized in the view finder 402. The cell 418 currently 
selected by the four-way navigation control 406 is encircled 
with a highlighted area 419, which is shown as a selection 
rectangle. Other shapes for the highlighted area are also 
suitable. 

Although the user interface 400 provides many 
advantages, the cells 418 for displaying captured images 
suffer the same drawbacks as the cells used in conventional 
digital cameras. The principal drawbacks being a general 
failure in aiding the user in distinguishing among the cap- 
tured images, and the requirement of processing each cap- 
tured image in order to display its corresponding image cell 
418. 

According to the present invention, the failure of aiding 
the user in distinguishing among captured images is 
addressed by expanding the image cells 418, and by includ- 
ing additional information in the expanded image cells 418, 
besides a small graphic of the captured image. 

FIG. 5 is a block diagram showing a digital camera user 
interface 430 displaying a series of expanded ceUs 420 in 
accordance with the present invention. The user interface 
430 is also shown with another preferred embodiment for 
the layout of the interface buttons, where Uke components in 
FIGS. 4 and 5 have like reference numerals. 

FIG. 6 is a block diagram illustrating the format of an 
expanded cell 420. According to the present invention, each 
cell 420 includes an image area 422 and an icon/information 
area 424. The icon/information area 424 may be placed in 
various positions relative to the image area 422. However, in 
a preferred embodiment, the icon/information area 424 is 
displayed on the right-hand side of each cell 420 as shown. 

The icon/information area 424 is for displaying one or 
more graphical icons, and/or for displaying text information. 
The icons and text information displayed in the icon/ 
information area 424 indicate to the user what media types 
have been associated with the image displayed in the image 
area 422. As used conventionally, the phrase "associating a 
media type with an object" means identifying the specific 
types of media included in that object, such as graphics, text, 
and sound. 

FIG. 7 is a table listing example media types and corre- 
sponding icons that may be associated with a captured 
image. The media type of a captured image may represent a 
single image, a time lapse or burst image, a movie clip, or 
a panorama. The media type may also represent sound, 
where the corresponding icon indicates that a sound clip is 
attached to the image displayed in the image area 422. 

Other media types may also be associated with a captured 
image that are not shown in FIG. 7, such as a snide show and 
a folder, for example. A slide show comprises several images 
stored sequentially in the same file, while a folder is one or 
more images stored in the directory or folder. With such 
media types, the image area 422 would display the first 
image in the group or a representative image from the folder, 
and the icon/information area 424 would display an graphi- 
cal icon representing a slide show or folder, respectively. 

Displaying icons and text information in the icon/ 
information area 424 according to the present invention 



13,309 

6 

provides the user with an automatic method for categorizing 
and identifying common groups of captured images. 

The present invention also eliminates the need for pro- 
cessing captured images when displaying the image cells 
5 420, This is accomplished by extending the file format used 
to store the captured images. 

FIG. 8 is a block diagram of one preferred embodiment 
for a extended file format 460 for storing a captured image 
in accordance with the present invention. The extended file 
format 460 includes a standard header 462 for storing the 
date and time the image was captured, and JPEG data 464 
representing the captured image in compressed form. And in 
contrast to prior file formats, the extended file format 460 
also includes a small version of the captured image, referred 
to here as a thumb nail image 466. 

Including the thumb nail image 466 in the extended file 
format 460 enables the digital camera to directly display an 
image in the image area 422 without processing the JPEG 
data 464. When the digital camera 118 is to display a scries 
of image cells 420 in the view finder 402, the corresponding 
file formats 460 are first retrieved from memory. The digital 
camera 118 then displays the thumb nail image 466 directly 
from the file 460 in the image area 422 of the cell 420, rather 
than first decompressing and resizing the JPEG data 464. 
^ Avoiding the processing the actual JPEG data 464 in this 
manner improves the speed at which the camera 118 may 
display the series of image cells 420 in the view finder 402. 

FIG, 9 is a block diagram of a second preferred embodi- 
ment for the extended file format 470 that supports multiple 
media types. As in the previous embodiment, the extended 
file format 470 includes a standard header 462', JPEG data 
464', and a thumb nail image 466'. To enable different media 
types to be associated with a captured image, the extended 
2^ header 470 also includes an information field 472 and a 
sound field 474. 

The information field 472 comprises a series of tags for 
storing information regarding the image represented by the 
JPEG data 464'. Media type tags indicate the media type of 
the image, such as whether the image is a single image or a 
panorama image, for example. The media type tags are used 
to select the type of icon is displayed in the icon/information 
area 424 of a cell 420 when the thumb nail 466 of the image 
is displayed. 

45 In operation, when the digital camera 118 is required to 
display a set of cells 420 in the view finder 402, the digital 
camera 118 first retrieves each image's extended file 470 
from memory. After the appropriate file is retrieved, the 
thumb nail 466' is displayed in the image area 422 of the cell 

50 420. While the thumb nail is being displayed, the tags stored 
in the information field 472 are read. Based on the content 
of the tags, the appropriate icon is then displayed in the 
icon/information area 424 of the cell 420. 

Besides media tags, the information field 472 may also 

55 include other types of tags for storing additional information 
regarding the image and/or the camera 118 itself. For 
example, a tag could be used to indicate the settings of the 
camera 118 at the time the image was captured, or indicate 
the identity of the camera manufacturer, for instance. The 

60 information in these tags may be accessed through the 
buttons on the camera interface 430. The information may 
then be displayed either as text in the icon/information area 
424, or displayed in a dialog box that is displayed in the view 
finder 402. 

65 Displaying media icons and other infonmation in the 
icon/information area 424 provides the advantage of indi- 
cating to the user information regarding the images that the 
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user otherwise would not have immediate access to. This 
feature provides a digital camera interface that is both easy 
to user and more user friendly than traditional interfaces. 

Referring still to FIG. 9, as stated above the expanded file 
format 470 also includes a sound field 474. The sound field s 
474 contains digital sound data that has been recorded for 
the image using the sound button 414, or contains a sound 
clip that has otherwise been associated with the image. 
When the user selects one of the cells 420 in the view finder 
402, the full-sized image is displayed in the view finder 402 lO 
from the JPEG data 464, while sound is played using the 
sound from the sound field 474. 

The extended file format 470 of the present invention also 
supports multiple image media types. Multiple image media 
types are media types that comprise more than one image. 
Examples include a timclapse, a slide show and a movie clip. 
In multiple image media types, the multiple images are 
preferably stored in one file, 

FIG. 10 is a block diagram illustrating a multiple image 
file format 480 that supports these multiple image media 
types. As shown, the multiple image file format 480 pref- 
erably includes a series of extended file formats 470 that 
correspond to each image in the multiple image file. The 
multiple image file format 480 also includes a header 482 
pointing to each of the extended file formats 470'. In ^ 
operation, the file is retrieved and the header 482 is read in 
order to sequentially access each of the extended file formats 
470. Each of the extended file formats 470 are then \ised to 
display their respective images in the view finder 402. Other 
formats for the multiple image file format 480 may also be 
used. For example, the file format 480 could comprise only 
one header 482, one thumbnail, and multiple JPEG data 
files. 

A method and system for displaying images in the inter- 
face of a digital camera has been disclosed. Although the 
present invention has been described in accordance with the 
embodiments shown, one of ordinary skill in the art will 
readily recognize that there could be variations to the 
embodiments and those variations would be within the spirit 
and scope of the present invention. Accordingly, many 
modifications may be made by one of ordinary skill in the art 
without departing from the spirit and scope of the appended 
claims. 

What is claimed is: 

1. A method for displaying a series of images captured by 
a digital camera, the digital camera including a user interface 
that includes a view finder, the method comprising the steps 
of: 

(a) storing each one of the captured images, each one of 
the captured images having one or more media types 
associated therewith, wherein the media types include 
a still image, a burst image, a time lapse image, a 
panorama irhage, a movie clip, and sound; 

(b) displaying a plurality of image cells in the view finder, 55 
wherein each of the image cells corresponds to one of 
the captured images; 

(c) providing at least one of the image cells with an image 
area for displaying the corresponding captured image; 

(d) providing the at least one image cell with an icon area 60 
adjacent to the image area for displaying additional 
information regarding the corresponding captured 
image; and 

(e) displaying graphical icons in the icon area indicating 
the media types associated with the captured image. 65 

2. A method as in claim 1 wherein step (a) further includes 
the step of: 
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(al) storing each of the captured images in a file format 
that includes compressed image data, thumb nail image 
data, and information indicating the associated media 
types. 

3. A method as in claim 2 wherein step (c) further includes 
the step of: 

(cl) displaying the captured image in the at least one 
image cell by displaying the thumb nail image date 
from the respective file format. 

4. A method as in claim 3 wherein step (a) further includes 
the step of: 

(a2) storing media type information in the file format 
regarding the media types associated with the respec- 
tive captured images. 

5. A method as in claim 3 wherein step (d) further includes 
the step of: 

(d3) displaying text in the icon area of the at least one 
image cell corresponding to the media type information 
stored in the file format. 

6. A method as in claim 5 wherein step (a) ftxrther includes 
the step of: 

(a3) storing media types comprising multiple images in a 
multiple media type file format, the multiple media 
type format including plurality of file formats for each 
of the multiple images, and a header for pointing to 
each of the file formats. 

7. A system for displaying a series of images captured by 
a digital camera, the digital camera including a user interface 
that includes a view finder, the system comprising: 

means for storing each one of the captured images, each 
one of the captured images having one or more media 
types associated therewith, wherein the media types 
include a still image, a burst image, a time lapse image, 
a panorama image, a movie clip, and sound; 

means for displaying a plurality of image cells in the view 
finder, each of the image cells corresponding to one of 
the captured images, wherein at least one of the image 
cells includes an image area for displaying the corre- 
sponding captured image, and an icon area adjacent to 
the image area for displaying additional information 
regarding the corresponding captured image; and 

means for displaying graphical icons in the icon area 
indicating the media types associated with the captured 
image. 

8. A system as in claim 7 wherein each of the captiued 
images are stored in a file format that includes compressed 
image data, thumb nail image data, and information indi- 
cating the associated media types. 

9. A system as in claim 8 wherein the captured image is 
displayed in the at least one image cell by displaying the 
thumb nail image data from the respective file format. 

10. A system as in claim 9 wherein media type informa- 
tion for each captured image is stored in a respective file 
format, 

11. A system as in claim 10 wherein text is displayed in 
the icon area of the at least one image cell corresponding to 
the media type information stored in the file format, 

12. A system as in claim 11 wherein media types com- 
prising multiple images are stored in a multiple media type 
file format, the multiple media type format including plu- 
rality of file formats for each of the multiple images, and a 
header for pointing to each of the file formats. 

13. A digital camera device comprising: 

a memory device coupled to the digital camera device for 
storing sets of image data, each set of the image data 
having one or more media types associated therewith, 
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wherein the media types include a still image, a burst 
image, a time lapse image, a panorama image, a movie 
lip, and sound; 
a memory manager for allocating storage locations within 
the memory device to store the sets of image data, the 5 
image data stored in a file format that includes the 
image data, a thumb nail image of the image data, and 
an information field for storing information regarding 
the image data, including the associated media types; 
and 
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an interface coupled to the memory device for displaying 
a plurality of image cells corresponding to the image 
data, wherein at least one of the image cells includes an 
image area for displaying the thumb nail image of the 
corresponding image data, and an icon area adjacent to 
the image area for displaying additional information 
regarding the corresponding image data, including 
graphical icons indicating the media types associated 
with the captured image. 

* * * * ♦ 
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